The Astronomy Commons Platform: A Deployable Cloud-based Analysis Platform for Astronomy

Abstract We present a scalable, cloud-based science platform solution designed to enable next-to-the-data analyses of terabyte-scale astronomical tabular data sets. The presented is built on Amazon Web Services (over Kubernetes and S3 abstraction layers), utilizes Apache Spark the Astronomy eXtensions for parallel analysis manipulation, provides familiar JupyterHub web-accessible front end user access. outline architecture platform, provide implementation details rationale (and against) technology choices, verify scalability through strong weak scaling tests, demonstrate usability an example from Zwicky Transient Facility’s 1Bn+ light-curve catalog. Furthermore, we show how this system enables iteratively build (in Python) that transparently scale processing with no need end-user interaction. be deployable by astronomers moderate cloud engineering knowledge, or (ideally) IT groups. Over past 3 yr, it has been utilized platforms DiRAC Institute, ZTF partnership, LSST Solar System Science Collaboration, Interdisciplinary Network Collaboration Computing, as well numerous short-term events (with over 100 simultaneous users). In live demo instance, deployment scripts, source code, cost calculators are accessible. 4 http://hub.astronomycommons.org/